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ABSTRACT 


Separably-inflnlte  Programs 
by 

A.  Charnes,  P.  R.  Gribik  and  K.  0.  Kortanek 


Separably-lnfinite  programs  are  a class  o£  linear  infinite  programs 
that  are  related  to  semi-infinite  programs  and  which  have  applications  in 
economics  and  statistics.  These  programs  have  an  infinite  number  of  variables 
and  an  infinite  number  of  constraints.  However,  only  a finite  number  of 
variables  appear  in  an  infinite  number  of  constraints,  and  only  a finite 
number  of  constraints  have  an  infinite  number  of  variables.  Duality  in 
this  class  of  programs  is  studied  and  used  to  develop  a system  of  nonlinear 
equations  satisfied  by  optimal  solutions  of  the  primal  and  dual  programs. 

This  nonlinear  system  has  uses  in  numerical  technique^  for  solving  separably- 
lnfinite  programs. 


Key  Words;  Semi-infinite  Programming,  Separably-lnfinite  Programming, 
Generalized  Finite  Sequence  Space,  Moment  Cone,  Duality, 
Nonlinear  System. 
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1.  Introduction 


In  some  recent  applications  of  mathematical  programming  in  statistics 
and  economics,  a new  class  of  linear  programs  can  be  defined.  These 
formulations  have  an  Infinite  number  of  variables  and  an  Infinite  number 
of  constraints.  As  such,  they  are  in  the  class  of  infinite  programs  [3]; 
however,  they  possess  additional  structure.  Only  a finite  number  of 
variables  appear  in  an  infinite  number  of  constraints  and  only  a finite 
number  of  constraints  have  an  infinite  number  of  variables.  These  programs 
are  closely  related  to  semi-infinite  programs  [1]  which  can  be  considered 
to  be  a subclass  of  this  formulation. 

This  class  of  programs  is  of  use  in  the  study  of  the  optimal  experimental 
design  problem.  In  this  problem,  one  wishes  to  allocate  measurement  resources 
to  points  in  a given  region  so  that  the  measurements  obtained  can  be  used 
to  make  "good"  estimates  of  some  unknown  constants  in  a linear  regression 
problem.  In  [5,  Section  6],  this  allocation  problem  is  formulated  as  a 
linear  program  in  which  the  Fisher  information  matrix  related  to  the  allocation 
must  satisfy  an  infinite  number  of  linear  inequalities.  The  information 
matrix  depends  upon  the  allocation  via  a finite  number  of  linear  equalities. 

If  the  points  at  which  measurements  are  possible  are  infinite  in  number,  the 
allocation  has  an  infinite  number  of  variables.  Thus  this  linear  program 
is  of  the  class  we  will  examine. 

There  are  also  applications  of  this  class  of  programs  in  economic 


equilibrium  problems. 


2 


I 


2,  An  Expansion  of  a Seml-lnflnlte  Program 

In  order  to  Introduce  the  programs  ve  study  in  this  paper  we  first 
consider  a semi -infinite  program. 


Program  I;  Let  S ^ a set  in  and  let  u(-)5S  r”,  "♦  R 

and  ceR*^, 

Find  Vj  ■ inf  c"^* 

from  among  xGR”  which  satisfy  (t)x  ^ u . (t)  for  all  teS,  // 


The  dual  we  give  for  Program  1 uses  the  concept  of  a generalized  finite 

(C\ 

sequence  space  [1],  Denote  by  R'  ^ the  set  of  all  X(»):S  -♦  R which 

assume  non-zero  values  at  finitely  many  points  only;  that  is  all  X(*) 

with  finite  support.  The  vector  space  R'  ' is  termed  a generalized 

finite  sequence  space.  If  the  set  S contains  an  infinite  number  of 
(S) 

points,  ’ is  obviously  infinite  dimensional.  , 

The  following  program  is  a dual  for  Program  I. 


Program  II 


Find  V = s^  S 


from  among  X(*)®R'  ’ which  satisfy 

S u(t)  X(t)  « c 
teS 

X(-)>0.  // 


The  duality  of  Programs  I and  II  has  been  studied  extensively,  [l)[2]r8l. 

The  programs  we  consider  have  characteristics  in  common  with  both  of 
the  above  programs. 


I 


^ 

3 

Program  P;  Let  S c q c and  let  u(. ) :S  “»  r” , •)  :S  “»  R 

V(.);Q  -*  R”,  V (OiQ  •*  R,  cBr",  bep"*  and  AeR*"’'". 

IHtX  ■ 

Find  V_  « inf  c^x  - Tj  v (r)‘n(r) 

^ — req 

from  among  xSr”  and  TlCO^R^^^  which  satisfy 

u’^(t)x  > for  all  teS  (la) 

Ax  + £ v(r)'n(r)  ■ b (lb) 

req 

and  T1(*)>0.  //  (Ic) 

If  the  sets  S and  q contain  an  infinite  number  of  points^  Program  P 
has  an  infinite  number  of  constraints  and  an  infinite  number  of  variables. 

Therefore,  it  is  «n  infinite  program.  However,  the  constraints  (la)  which 
are  infinite  in  number  contain  only  a finite  number  of  variables,  while  the 
constraints  (lb)  which  contain  an  infinite  number  of  v^ariables  are  finite 
in  number.  Because  of  this  property,  Program  P is  closely  related  to 
Programs  I and  II  and  we  call  it  a separably>infinite  program. 


if Mi-ilw  II  ■ rfn 
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3.  Duality  in  Separably-lnflnite  Progranrolni 

Proceeding  in  a formal  manner,  the  following  program  is  obtained  as 
the  dual  for  Program  P. 

Program  D; 

Find  - su£  L “n+1^^^ 


tes 


from  among  and  yeR™  which  satisfy 


’I'i 


£ u(t)  X(t)  - a'*’ y « c 

tes 

(r)y  ^ all  reQ 

and  X(*)  ^ 0.  // 

Program  D is  also  separably  infinite. 


(2a) 

(2b) 

(2c) 


Lemma  1;  Programs  P and  D are  in  duality  in  that  for'  x,T|(.)  feasible  for 
Program  P and  y,X(*)  feasible  for  Program  D, 

c'^x  - 1j  Vjj^i(r)'n(r)  > L u^j.i(t)  X(t)  - b^y. 


reQ 


tes 


h+1 


Proof;  Using  (la) , (lb)  , and  (2c) , 


L u (t)  X(t)  -by 

tes 


< S (u’^(t)x)  X(t)  - y'^(Ax  + S v(r)Tl(r)) 
tes  reQ 

- (S  u(t)  X(t)  - A’^y)’^x  - 1/  v’^(r)yTl(r). 
tes  reQ 


ir''  T-;  V f i--  - '-f-y«vX'— -tv— v 
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Using  (2a),  (2b)  and  (Ic),  this  last  expression  is  less  than  or  equal  to 


c X - Ti  V (r)'IKr).  // 

req 


Lemna  1 shows  that  Programs  P and  D satisfy  the  duality  inequality 
^ Vp.  Under  additional  assumptions,  this  is  an  equality.  Rather  than 
study  the  relations  between  Programs  P and  0 in  full  generality,  we  will 
add  assunq>tions  that  usually  hold  in  practice  and  which  permit  us  to  develop 
relationships  useful  in  computational  techniques. 

The  following  sets  are  convenient  in  the  following  developments; 


K_  s {xeR"  I u’’(t)x>  u .,(t)  for  all  tes], 
d •“  n+1 

Kq  = [yeR'"  1 v'^(r)y  > v^^(r)  for  all  req), 
C ^ is  the  convex  cone  generated  by 


1 (;')  ■ 


C-Q  c R is  the  convex  cone  generated  by 


i<'>)  ' 


req  I U 


C-g  and  C'q  are  often  called  moment  cones. 


The  following  assumptions  are  made  throughout  the  remainder  of  the 


paper. 
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(Al) 

Either  the  set 

(A2) 

The  set 

Kq  is 

(A3) 

The  cone 

Lemma  2; 

Let  gep’'' 

and  1 

= 0. 


T N. 

X g ^ h for  all  xeK„  . 


Proof;  Consider  the  polar  cone  of  Cu 


“■s  - «*”.  Vi®  I + W - “ •“  {i)  ®=s  I 


Since  C-g  is  assumed  to  be  closed,  we  have 

•ff  •fg 

(Cy  o C.g  ([9]  Theorem  14.1  or  flO]  Lemma  2.7.6). 
Thus  if  and  only  if 

- Vl^^O  for  all  J ee*  . 

\ n+1' 

Now  Gg  is  generated  by 

lew-i^ior 

Thus 


(Gn+l) 


u(t) 


- "n+1  “n+1^^^  ~ ° 

”^0  “ I • 


whenever 


u(t)  ^ 0 for  all  tcS.  (4c 

If  (4a),  (4b)  and  (4c)  hold,  then  obviously 

g - h ^ 0 (5a 

whenever 

w'^u(t)  > 0 (5b 

Now  suppose  that  (5a)  and  (5b)  are  satisfied  by  w.  Then  for  any  o ^ 0, 
av  satisfies  (5b)  and  so 

Qfw"'*’ g - h ^ 0 for  all  or  ^ 0 
or 

w^g  ^ 0. 

If  we  set  w = 0,  we  get 
-h  > 0. 

Thus  (5a)  and  (5b)  imply  (4a) , (4b)  and  (4c) . // 

Lemma  2 is  used  in  showing  that  a duality  equality  exists  between 
Programs  P and  D under  our  assumptions. 

Theorem  1;  If  Program  P is  feasible  and  finite  valued,  then  Program  D is 
feasible  and  Vp  = V^.  Moreover,  Program  D assumes  its  supremum  as  a 
maximum. 


Proof;  Program  P can  be  written  in  the  following  form; 
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Find  Vp  = inf  z 


from  among  xGr’'’,  z€R,  weR  which  satisfy 


u^(t)x  ^ for  all  teS 


B*  .5, 


and  ^ 0,  w ^ 0.  // 


This  is  equivalent  to  the  following  form. 


Find  Vp  = inf  z 


from  among  x€R  , zCR  which  satisfy 
X€K„ 


/b  - Ax  \ 

( T I e // 

\ z - c X / Q ' 


Let  us  define  the  set  K c:  R 


n+1 


IC ; ?.)  I 


xEK-  and  z V„ 
S P 


Since  K„  is  convex,  K is  also  convex.  Now  V is  the  value  of 
« P 


Program  P.  Thus  there  cannot  be  an  xeK„  and  z V such  that 

P 


V z - c x/  ^ 


Hence 


K = 0. 
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Since  K and  are  disjoint,  non-empty  convex  sets,  we  can  find 

hyperplane  that  separates  them  (flO]  Theorem  3.3,9  or  fS]  Theorem  11,3). 
That  is,  there  exist  yeR*"  and  y^^eR,  not  both  zero,  such  that 


^m+l  ‘‘mfl  - ° i2E  £11 


(4) 


7 *r 

y (b  - Ax)  + y (z  - c^x)  < 0 


for  all  xeK„  and  z < V , 

a — p 


for  all  reQ  and^Jje^^Q.  Thus  (6)  implies  that 


7 

y v(r)  - y V (r)  > 0 for  all  reQ 


' -^mfl  "iiH-l''  ^ (o) 

7 s 

1^  yjn+i  yv(r)^0  for  all  reQ  which  implies  that  y is  a direction 

of  infinity  of  K^,  which  contradicts  the  assumption  that  is  bounded, 

^m+l  ^ dividing  (7)  and  (8)  by  y^^,  we  obtain 
T s. 

y v(r)  £ v^l(r)  for  all  reQ  (9) 


7 T 

y (b  - Ax)  + (z  - c x)  < 0 for  all  xeK-  and  z < V . 

— S p* 


This  in  PntlAl  4 Ka  AM  Hr. 
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Since  C-g  is  closed. 


Thus  there  exist  a X(*)eR^^^  and  wSR  which  satisfy 

+ c - Zi  u(t)  X,(t) 
tes 


(10) 


(U) 
(12) 

is  feasible  for 

Remark  1:  Let  us  make  the  following  assumptions. 

(Al*)  Either  the  set  .is  non-empty  and  bounded  or  v (.)  » 0. 

W Iftrl 

(A2*)  The  set  Kg  is  non-empty  and  bounded. 

(A3*)  The  cone  is  closed. 

Under  these  assumptions,  if  Program  D is  feasible  and  finite  valued,  then 
Program  P is  feasible,  attains  its  value  and  = V^. 

Remark  2;  Let  us  assume  that  the  sets  Kg  and  Kp  are  non-empty  and 
bounded.  Also,  assume  that  and  C>g  are  closed.  Then,  if  either 

program  is  feasible  and  finite  valued,  the  other  program  is  feasible  and 
has  the  same  value.  Moreover,  both  programs  attain  their  values. 


-b^y  - Vp  - T>  -«^i(t)  X(t)  + w 
^(*)  ^ 0 and  w ^ 0. 

Combining  (9),  (10)  and  (12),  we  have  that  y,X(*) 
Program  D.  Using  Leimna  1,  (11)  and  (12),  we  have 

''p  £ Vl<'>  ^ ''d  i ''p-  » 
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The  next  lemma  shows  that  we  do  not  have  to  consider  X(.)eR^®^  with 
arbitrarily  large  support. 

Leinma_3:  Suppose  that  Program  D assumes  its  value.  Then  there  exists  a 
pair  y*€R  , X*(.)eR^  ^ with  X*(.)  having  at  most  n points  in  its 
support  at  which  Program  D assumes  its  value. 

Proof;  Suppose  that  Program  D assumes  its  value  at  },  i(.).  Then 


- J 


eCg  for  all  z Vj^, 


(13a) 


for  2 > Vjj  . 


(13b) 


From  Caratheodory's  theorem  for  cones,  we  have  that  there  exist  t ...  t 
„ A A 1 * r 

in  S and  ^ which  satisfy  ’ 


T*  A » 


A A ^ ^ 

A y + c a 2^  p u(t  ) 
i=l  ^ ^ 

A V 

Pi  C 0 for  i«l,...,nfl 


Consider  the  program 


IITA 

“*  "i 


from  amonf 


Pl»”‘»Pn+i  in  R which  satisfy 


1-1  ^ f 

Pi  - 0 for  i - l,...,n+l,  // 


Relations  (13a)  through  (16)  show  that  the  value  of  this  program  is 
T* 

b y + Vjj,  and  the  theory  of  linear  prograinning  shows  that  this  value 
can  be  achieved  with  at  most  n of  the  variables  positive.  // 

Remark  3;  If  we  assume  that  Program  P attains  its  value,  we  can  show  in 
the  same  fashion  that  it  assumes  its  value  at  a pair  x*eR",  ‘n*(.)eR^^^ 
such  that  ^(•)  has  at  most  m points  in  its  support. 

The  last  duality  relation  that  we  consider  in  this  paper  is  a 
complementary  slackness  result. 

Theorem  2;  Let  x*,  ‘n^(*)  be  optimal  for  Program  P and  let  y*,  X*(«) 
be  optimal  for  Program  D.  Then 


(u  (t)x*  - u^j^(t))X*(t)  = 0 for  all  t€S 


(v  (r)y*  - V (r))Tl>v(r)  = 0 for  all  reQ. 


Proof;  From  Theorem  1,  we  have  that  = Vj^,  thus 

c’’x*  - Tj  V (r)Tpf(r)  = E u (t)X*(t)  - b^y* . 


Using  (lb)  and  (2a),  this  can  be  written  as 

- »^i(t)]x.(t)  - - £ [v^(r)y.  - v^j(r)]Tl.(r), 


From  (la) , 


'■(t)x*  - « .■i(t)  ^ 0 for  all  teS; 


while  (Ic)  gives  X*(t)  ^ 0 for  all  teS.  Thus  the  left  hand  side  of  the 
equation  is  non-negative.  From  (2b), 


7 

V (r)y*  - V^^(r)  > 0 for  all  reQ; 

while  (2c)  gives  Tl*(r)  > 0 for  all  reQ.  Thus  the  right  hand  side  of 
the  equation  is  non-positive.  Therefore,  the  only  way  the  equation  can  be 
true  is  if  everything  is  zero,  ft 


r 

f 
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4.  A Nonlinear  System  for  Separably-infinite  Programs 

One  of  the  most  successful  methods  for  solving  semi -infinite  programs 
consists  roughly  of  the  following  steps; 

(1)  Replace  the  region  S of  Program  1 by  a subset  containing  a finite 
number  of  points  and  solve  the  resulting  finite  linear  program 
and  its  dual. 

(il)  Use  the  results  of  (i)  to  find  a starting  point  for  Newton-Raphson 
iterations  on  a system  of  nonlinear  equations  obtained  from 
duality  relationships  between  Programs  I and  II  [4],  fb],  [7], 

In  this  section,  the  results  of  Section  3 are  used  in  developing  a 
nonlinear  system  for  separably-infinite  programs  that  is  similar  to  that 
developed  by  Gustafson  and  Kortanek  for  semi-infinite  programs.  An  additional 
assunq>tion  is  imposed. 

(A4)  Denote  by  “j(*)  J-th  component  of  u(*)  and  by  Vj(*)  the 

j-th  consonant  of  v(*).  Let  '^n+l^*^  continuously  differen- 

tiable on  an  open  region  containing  S;  and  let  v, (•)»... »v  .,  (•)  be 
continuously  differentiable  on  an  open  region  containing  Q. 

Lemma  4;  Let  xBr”,  'I](«)eR^^^  be  feasible  for  Program  P.  If  t is  in 
the  Interior  of  S and 


1/  7u,(t)x  - (t)  . 

j-1  J J 
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Proof;  Since  the  pair  x,T|(*)  is  feasible,  the  function 

0(0  - u’^COx  - 

is  non-negative  on  S;  and,  therefore,  t is  a point  at  which  the  miniiouin 
is  attained.  Since  t is  in  the  interior  of  S, 

V0(t)  - 0.  // 

Lemma  4 holds  for  Program  D with  appropriate  changes  of  notation. 

Let  us  assume  that  Program  P attains  its  value.  By  Remark  3,  we  have 
that  there  exists  a pair  x*eR",  iyf(*)eR^*^^  at  which  Program  P attains  its 
value  such  that  'H^CO  most  m points  in  its  support.  Let 

{rj^,...,r^)  be  the  support  of  T1*(0  and  let  T\^  = 

By  Theorem  1 and  Lemma  3,  there  exists  a pair  y*eR  , X*(*)6R'’  at 
which  Program  D attains  its  value  such  that  X*(0  has  at  most  n points 
in  its  support.  Let  {tj^,...,tp3  he  the  support  of  X.*(*)  and  let 
X*  « X*(t^). 

Because  of  the  feasibility  of  these  pairs  and  Theorem  2,  they  must 
satisfy  the  following  equations. 


® ‘ ‘ 

(17a) 

»j<ri)y*  - . 0 for  1-1 , 

(17b) 

Ax*  + t v(r  )T1*  « b 

(17c) 

1-1  ^ ^ 

-A^y*  + ^ u(t  )X*  - c 

1 * * 

(17d) 
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If  tj^ tp  are  in  the  interior  of  S and  if  rj^,...,r^  are 

the  interior  of  Q,  Lemma  4 yields  the  following  equations. 


in 


<17e) 


(17f) 




Once  p and  q are  set,  the  unknowns  in  system  (17)  are  x*eR®, 

and  X^^CR  for  i*l,...,p,  r^eR"^  and  Tl*eR  for  i«l q. 

System  (17)  consists  of  p + q + m + n + kp  + qX  nonlinear  equations  in  the 
same  number  of  variables  that  are  satisfied  at  the  optima.  System  (17)  and 
its  uses  in  numerical  techniques  are  analogous  to  the  corresponding  system 
for  semi-infinite  programs  and  its  uses. 


in 


Remark  4;  In  developing  (17e),  we  assumed  that  t^^  for  1=1,..., p are 
the  Interior  of  S.  If  some  t^  is  a boundary  point  of  S,  then  some 
Independent  vectors  hj^,h2, . . . .h^  (f  ^ k)  may  possibly  be  found  such  that 
for  a 6^0, 


t^  + eh  es  for  -6  < e < 6. 

is  “ — 


We  have  that 


- T, 


8s (®)  ^ “ Vl^‘^1  + 

is  non-negative  for  -6  £ e £ 6 with  gg(0)  »»  0.  Thus 


r 
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for  s = These  equations  should  be  Included  in  (17e)  in  place 

of  the  vector  equation  for  t^.  The  same  result  holds  for  an  r^  which 
is  a boundary  point  of  Q, 


1 


5.  Conclusion 


In  this  paper,  we  introduced  a class  of  infinite  programs  that  have 
applications  in  economics  and  statistics.  The  duality  of  these  programs 
was  examined  under  assumptions  that  are  usually  satisfied  by  practical 
problems  and  permit  us  to  develop  duality  relationships  that  are  useful 
in  developing  numerical  techniques.  The  development  of  these  techniques 
will  be  explored  in  future  papers.  Also,  the  duality  in  separably-infinlte 
prograoBilng  will  be  studied  in  more  generality. 
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13.  AOSTMAC  T 
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12.  SPONSORING  MILI  T ARY  ACTIVITY 
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Separably-infinite  programs  are  a class  of  linear  infinite  programs  that 
are  related  to  semi-infinite  programs  and  which  have  applications  in 
economics  and  statistics.  These  programs  have  eui  infinite  number  of  variables 
and  an  infinite  number  of  constraints.  However,  only  a finite  number  of 
variables  appear  in  an  infinite  number  of  constraints,  and  only  a finite 
number  of  constraints  have  an  infinite  number  of  variables.  Duality  in  this 
class  of  programs  is  studied  and  used  to  develop  a system  of  nonlinear 
equations  satisfied  by  optimal  solutions  of  the  primal  and  dual  programs.  This 
nonlinear  system  has  uses  in  numerical  techniques  for  solving  separably-infinite 
programs. 
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